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Abstract: This paper presents a survey on quantum control theory and applica- 
tions from a control systems perspective. Some of the basic concepts and main 
developments (including open-loop control and closed-loop control) in quantum 
control theory are reviewed. In the area of open-loop quantum control, the paper 
surveys the notion of controllability for quantum systems and presents several con- 
trol design strategies including optimal control, Lyapunov-based methodologies, 
variable structure control and quantum incoherent control. In the area of closed- 
loop quantum control, the paper reviews closed-loop learning control and several 
important issues related to quantum feedback control including quantum filtering, 
feedback stabilization, LQG control and robust quantum control. 
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1 Introduction 

Quantum control theory is a rapidly evolving research area, which has developed over 
the last three decades [JJ-[9]. Controlling quantum phenomena has been an implicit 
goal of much quantum physics and chemistry research since the establishment of quan- 
tum mechanics [5] , [6] . One of the main goals in quantum control theory is to establish 
a firm theoretical footing and develop a series of systematic methods for the active 
manipulation and control of quantum systems [7j. This goal is nontrivial since mi- 
croscopic quantum systems have many unique characteristics (e.g., entanglement and 
coherence) which do not occur in classical mechanical systems and the dynamics of 
quantum systems must be described by quantum theory. Quantum control theory has 
already attained significant successes in physical chemistry [9]-[l3], atomic and molec- 
ular physics [6], [H] and quantum optics [IS], [16], and has also contributed to the 
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understanding of fundamental aspects of quantum mechanics [17] ■ In recent years, the 
development of the general principles of quantum control theory has been recognized as 
an essential requirement for the future application of quantum technologies [18] . Quan- 
tum control theory is drawing wide attention from different communities in the areas of 
physics, chemistry, control theory, applied mathematics and quantum information, and 
has become a regular topic in international conferences such as the IEEE Conference 
on Decision and Control. An international workshop on "Principles and Applications 
for Control of Quantum Systems (PRACQSYS)" has also been sponsored since 2004 to 
discuss recent developments in this area [7J. This paper will present the basic concepts 
and main developments of quantum control theory from a control systems perspective. 

In much of quantum control theory, the controllability of quantum systems is a 
fundamental issue. This issue concerns whether one can drive a quantum system to a 
desired state [3J. This problem has practical importance since it has a close connec- 
tion with the universality of quantum computation |19] and the possibility of achieving 
atomic or molecular scale transformations [20] , [21] . Different notions of controllability, 
such as pure state controllability, complete controllability, eigenstate controllability and 
kinematic controllability, have been proposed [20]- [26], A common research focus is on 
finite dimensional (finite level) quantum systems for which the controllability criteria 
may be expressed in terms of the structure and rank of corresponding Lie groups and Lie 
algebras |25] . This method allows for an easy mathematical treatment of the problem 
for the case of closed quantum systems (i.e., isolated systems considered without exter- 
nal influences) and in some cases, methods from classical (non-quantum) control theory 
can be directly applied. However, the relevant criteria may be computationally difficult 
when the dimension of the quantum system to be controlled is large. Therefore, a con- 
trollability method based on graph theory has been proposed, and the corresponding 
controllability criterion is easier to verify |27j . |28j . Compared with finite dimensional 
closed quantum systems, the controllability of infinite dimensional quantum systems or 
open quantum systems (i.e., systems considered interacting with the environment; e.g., 
see [29]) is more difficult and only a few results have been obtained [21], [26], [30] . 

For a controllable quantum system, it is desirable to develop a good control strat- 
egy to accomplish the required control tasks on the quantum system [9]. The coherent 
control strategy is a widely used method where one manipulates the states of a quan- 
tum system by applying semiclassical potentials in a fashion that preserves quantum 
coherence |17j (a wave-like property of quantum systems allowing for constructive and 
destructive interference, e.g., see [5]). An early paradigm of quantum control was open- 
loop coherent control [5], which has successfully been used in the quantum control of 
chemical reactions [31] . [32] . Rigorous optimal control theory has been successfully 
applied to the design of open-loop coherent control strategies in order to find the best 
way of achieving given quantum control objectives in physical chemistry [12], |33] , 
|34j . Recently, time-optimal control problems for spin systems have been solved to 
achieve specified control objectives in minimum time [35], [36], [37]. Optimal control 
techniques have also been successfully applied to multidimensional nuclear magnetic 
resonance (NMR) experiments to improve the sensitivity of these systems in the pres- 
ence of relaxation [38] , [39] . [40j . Another useful tool in open-loop quantum control is 
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the Lyapunov-based control design approach [IT], [12]. In classical control, the Lya- 
punov method determines the control input as a function of the system state. Hence, 
it is a feedback control design method. In quantum control, it is difficult to acquire in- 
formation about quantum states without destroying them. Hence, the Lyapunov-based 
control methodology is used to first construct an artificial closed-loop controller and 
then an open-loop control law is obtained by simulation of the artificial closed-loop 
system. In coherent control, the control operations consist of unitary transformations. 
However, some quantum systems may not be controllable using only coherent controls. 
For such uncontrollable quantum systems, it may be possible to enhance the capabili- 
ties of quantum control by introducing new control strategies such as variable structure 
control and incoherent control (i.e., one is allowed to destroy coherence of the quantum 
systems during the control process). For example, a variable structure control method 
has been introduced in [33], [HJ to enhance the capabilities of quantum control for 
some specific systems which are not controllable. Incoherent control enables the effects 
of quantum measurements and incoherent environments to be combined with unitary 
transformations to complete quantum control tasks and enhance the performance of 
quantum control systems [13]- [55]. Incoherent control strategies have also been recog- 
nized as important techniques to assist coherent control strategies in quantum control 
systems. 

Although open-loop strategies using coherent or incoherent control approaches, op- 
timal control techniques and Lyapunov methods, have achieved important successes, 
their applications have many limitations. In classical control, closed-loop methods have 
many advantages over open-loop methods, such as robustness and reliability. For open 
quantum systems, coupling with uncontrollable environments makes the introduction of 
noises and uncertainties unavoidable [56j . A requirement for robustness in the presence 
of uncertainties and noises has been recognized as one of the key aspects in developing 
practical quantum technologies [7J , [57] . A natural solution to this problem is to develop 
closed- loop quantum control approaches. Two paradigms for closed- loop control have 
been proposed: closed-loop learning control and quantum feedback control [9j. Closed- 
loop learning control involves a closed-loop operation where each cycle of the loop is 
executed with a new sample, and this approach has achieved great success in controlling 
quantum phenomena in chemical reactions [9], |58] , Feedback is an essential concept 
in classical control theory, where information about the state variables obtained from 
direct measurements or state estimation is fed back to the system through a controller 
to achieve desired performance. Quantum feedback control has been used to improve 
the system performance in different tasks, including the control of squeezed states (a 
typical class of nonclassical states, e.g., see [59]) and entangled states (see Section 2.1), 
state reduction and quantum error correction [15], [60]- [69]. The success of feedback 
control is usually dependent on the acquisition of suitable feedback information. This 
problem becomes more complex and subtle in quantum control since quantum mea- 
surements unavoidably affect the states of measured systems. Hence, research aimed 
at establishing a general framework for quantum feedback is accelerating the develop- 
ment of some related areas including quantum filtering theory |70| . [71] . |72j . quantum 
parameter estimation [73) . |74j . |75j . quantum system identification [76], |77j . |78j and 
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quantum robust control [57], [79] . 

This paper will survey the development of open-loop and closed-loop methods in 
quantum control theory from a control systems perspective. We will also briefly discuss 
some applications of quantum control theory to quantum information technology [80 1. 
Many successful applications of quantum control in chemistry and physics are beyond 
the scope of this paper and, for these topics, readers can refer to several excellent books 
and review articles in the areas of chemical reactions [5] , [9] , [H] , [12] , [13] , [H] , [31] , 
[32] , atomic physics [6] , NMR [7J , [81] and quantum optics [82] . The remainder of this 
paper is organized as follows. Section [2] briefly introduces quantum states, quantum 
measurements and several quantum control models. In Section [3l the controllability of 
quantum systems and several open-loop control strategies, including optimal control, 
Lyapunov methods, incoherent control and variable structure control, are reviewed. 
Section H] presents some results on closed-loop control of quantum systems. In particu- 
lar, in this section, closed-loop learning control is briefly mentioned and some specific 
aspects of quantum feedback control are presented. Conclusions and perspectives are 
given in Section [5j 

2 Prerequisites 

In quantum control theory, the systems to be controlled are quantum systems whose 
dynamics are governed by the laws of quantum mechanics. Quantum mechanics pro- 
vides a mathematical framework for describing the states and evolution of quantum 
systems. In this section, we briefly introduce several related concepts for developing 
quantum control theory, such as quantum states, quantum measurements and quantum 
control models. A comprehensive introduction to quantum mechanics can be found in 
many excellent textbooks such as [83], [84] . 

2.1 Quantum states 

In quantum mechanics, the state of a closed quantum system can be represented by a 
unit vector \tp) (this notation is known as the Dirac representation [83] and the state 
is also called wavefunction) in a complex Hilbert space T~L. It is worth mentioning 
that the "state" in quantum mechanics is different from that in classical systems. For 
a classical system, the state usually describes some real physical properties such as 
position and momentum, which are generally observable. However, a quantum state 
cannot be directly observed and also does not directly correspond to physical quantities 
of the quantum system. Since the global phase of a quantum state has no observable 
physical effect, we often say that the vectors and e ia \il)) (where % = and a£R) 
describe the same physical state. A quantum state which can be represented with a 
unit vector \tp) is called a pure state. For example, in quantum information theory, 
information is coded using two-state (two-level) quantum systems (called qubits) and 
the state \ip) of a qubit can be written as 
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where 9 G [0,7r], (p € [0, 2ir]. Then |0) and |1) correspond to the states zero and one for 
a classical bit [80], [53] . 

In practical applications, the quantum systems to be controlled are usually not 
simple closed systems. They may be quantum ensembles or open quantum systems 
and their states cannot be written in the form of unit vectors. In this case, it is 
necessary to introduce the density operator or density matrix p : H — > H to describe 
quantum states of quantum ensembles or open quantum systems. A density operator 
p is positive and has trace equal to one. Suppose that a quantum system is in an 
ensemble {pj, \ipj}} of pure states; i.e., in a mixture of a number of pure states \ipj) 
with respective probabilities pj. The density matrix for the system is defined as follows 

p = Y,P^){i>j\ (2) 

j 

where = (IV'j))^ an d ^2jPj = 1- Here, the operation (-)t refers to the adjoint. For 
a pure state 1^), p = \ip)(ip\ and tr(p 2 ) = 1. If the state p of a quantum system satisfies 
tr(p 2 ) < 1, we call the quantum state a mixed state. 

A composite quantum system (assumed to be made up of two subsystems A and B) 
is defined on a Hilbert space H = Ha ®Hb, which is the tensor product of the Hilbert 
spaces Ha an d on which the subsystems A and B are defined. For the composite 
quantum system, its state pab can be described by the tensor product of the states of 
its subsystems; i.e., pab = Pa® Pb (e.g., see |80j). 

Considering any bipartite pure state \iP)ab, if it can be written as a tensor product 
of pure states \<p)a £ Ha and \x)b £ Hb, 

W)ab = \<P)A ® \x)b, (3) 

we call it a separable state; otherwise, we call it an entangled state [86]. Quantum 
entanglement is a uniquely quantum mechanical phenomenon which plays a key role in 
many interesting applications of quantum communication and quantum computation, 
and a detailed discussion can be found in the references [80J and [86J. 

2.2 Quantum measurements 
2.2.1 Projective measurement 

To better control a quantum system, it is often desirable to extract information from 
the controlled quantum system by means of measurements. Measurement theory in 
quantum mechanics is essentially different from that in classical mechanics since a 
measurement on a quantum system unavoidably affects the measured system (a de- 
tailed discussion of this issue can be found in [29]). In quantum mechanics, an ob- 
served physical quantity (called an observable) is expressed as a Hermitian operator 
on the Hilbert space H and one cannot simultaneously and precisely measure two 
noncommutative observables according to the Heisenberg uncertainty principle. A 
widely used measurement model is projective measurement (or von Neumann measure- 
ment). For an observable M, one can select a complete set of orthogonal projectors 
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{ p m ■ E m p m = 1 , p m = p m, p fh p m = ^m,,m p m} to describe a projective measurement, 
where P m is the projector onto the eigenspace of M with eigenvalue m, M = mP m 
and 5fh,m is the Kronecker delta [SU]. For a quantum system in the state |V>), the mea- 
surement outcome will correspond to one of the eigenvalues m of the observable M. 
The probability of occurrence of outcome m is p{m) = (^|P m |^»). Once the outcome 
m has occurred, the state of the measured system changes to p "^fL (this process is 

known as the collapse postulate) . For a mixed state p, the probability of outcome m is 
pirn) = tx{P m p} and the state is changed into P ™£^™ if we obtain the outcome m. 

2.2.2 Continuous measurement 

Projective measurements are treated as instantaneous and this model is reasonable 
when the strength of the measurement (i.e., the coupling strength between the mea- 
surement apparatus and the measured system) is large enough and the measurement 
time-scale is much shorter than all other related time-scales for a given task [87] . How- 
ever, this framework may not be sufficient to describe some important situations such 
as continuously monitoring some aspects of a quantum system [88], [89]. In quan- 
tum feedback control, it is important to continuously extract feedback information to 
adjust the system evolution. Hence, there is an essential requirement to develop a con- 
tinuous measurement theory for quantum feedback control. Fortunately, recent results 
have shown that continuous measurements are experimentally realizable for practical 
quantum systems such as solid-state qubits [90]. In continuous measurements, one can 
continuously monitor an observable of a quantum system and the evolution of the sys- 
tem described in terms of the measurement record can be obtained from a stochastic 
master equation [89J. Continuous measurements can be derived from projective mea- 
surements under appropriate assumptions. For example, to implement a continuous 
measurement on an atom, we let the atom interact with an auxiliary quantum system 
(e.g., an electromagnetic field), and then make projective measurements on the aux- 
iliary system (e.g., using a photodetector). In a short time interval, we extract only 
partial information about the atom. Hence, we also refer to continuous measurement 
as weak measurement or continuous weak measurement. For a detailed introduction 
to continuous measurement the reader can refer to [89 j . Also, the stochastic master 
equation which describes a quantum system under continuous measurement will be 
presented in the following subsection. 

2.3 Quantum control models 

This subsection will introduce four types of models used in quantum control: bilinear 
models (BLM) , Markovian master equations (MME) , stochastic master equation models 
(SME) and linear quantum stochastic differential equations (LQSDE). 
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2.3.1 Bilinear models 

The state \ip(t)) of a closed quantum system evolves according to the Schrodinger 
equation [M] 

tH^w)) = H m)), m = o)) = ivo) (4) 

where Hq is the free Hamiltonian of the system (i.e., a Hermitian operator on H), h 
is the reduced Planck's constant (we assume that h = 1 in this paper), and the initial 
state has unit norm HV'oll 2 = {ipo I ipo ) = 1- Eor simplicity, we consider finite dimensional 
quantum systems, which are appropriate approximations in many practical situations. 
For an iV-dimensional quantum system, T~L is an iV-dimensional complex Hilbert space, 
and the eigenstates {\<fii)}f = i (denoting D = {\4>i)}f =l ) of Hq form an orthogonal basis 
for T~L. In many situations, the control of the system may be realized by a set of control 
functions Uk(t) € M coupled to the system via time- independent Hermitian interaction 
Hamiltonians H k (k = 1, 2, . . . ). The total Hamiltonian H (t) = Hq + Uk{t)Hk then 
determines the controlled evolution 

i^\m) = [H +j2Mt)Hk]\m)- (5) 

The goal in a typical quantum control problem defined on the system (0) is to find 
a final time T > and a set of admissible controls Uk{t) £ M which drives the system 
from the initial state |"0o) into a predefined target state \ipf). The total Hamiltonian 
H(t) = flo + XLfc u k{t)Hk defines a unitary transformation (propagator) U(t) which can 
accomplish the transition from the pure state |-0o) to the pure state \ip(t)); i.e., 

m))=umo). (6) 

Substituting Q into ©, we can easily obtain 

iU(t) = [Hq +Y,Mt)H k P(t), U(0) = I. (7) 

k 

According to the quantum state superposition principle [83], the evolving state 
\ip(t)} can be expanded in terms of the eigenstates in the set D: 

N 

\m) = Y. c M^)- (8) 

Substituting ([8]) into ©, we let C(t) = {c\(t), C2(t), . . . ,c/v(t)} and obtain 

iC(t) = [H + J2Mt)H k ]C(t), C = (c 0j )f =1 , c 0j = <^# >. (9) 

k 

Equations ([5]), ([7|) or ([9]) are all referred to as finite dimensional bilinear models 
(BLM) of quantum control systems. If Equations ([5]), ([7]) and ([9]) are all controllable 
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(see Section 3.1), conversion between them is easily carried out. For the BLM (|7|), we 
find a set of admissible controls to generate a desired unitary transformation U (t) and 
then calculate the desired state trajectory using For the BLM Q, we find a set of 
admissible controls to achieve desired coefficient trajectories C(t) and then obtain the 
desired state trajectory using (jSJ). 

Bilinear models are widely used to describe closed quantum control systems such 
as molecular systems in physical chemistry and spin systems in NMR. For example, 
consider a spin 1/2 system in a constant magnetic field along z-axis and controlled 
by magnetic fields along x-axis and y-axis [91]. We denote the Pauli matrices a = 
(a x , a y , a z ) as follows: 

'• = (i o)' ~o)> ^ = G -i)' (10) 

The quantum control system under consideration can be described as follows: 

iU(t) = [h + u x (t)I x + u y (t)I y ]U(t), U(0) = I (11) 
where the controls u x (t),u y (t) G R, I x = \cr x , I y = \a y and I z = \o z . 

2.3.2 Markovian master equations 

If we use the density matrix p(t) to describe the state of a closed quantum system, the 
evolution equation for pit) can be described by the quantum Liouville equation 

ip(t) = [H(t),p(t)], (12) 

where [X, p] = Xp — pX is the commutation operator. In many practical applications, 
the quantum systems being considered are open quantum systems. In fact, this is the 
case for most quantum control systems since such systems unavoidably interact with 
their external environments (including control inputs and measurement devices). For 
an open quantum system, its evolution cannot generally be described in terms of a 
unitary transformation. In many situations, a quantum master equation for p(t) is a 
suitable way to describe the dynamics of an open quantum system. One of the simplest 
cases is when a Markovian approximation can be applied where a short environmental 
correlation time is supposed and memory effects may be neglected [29]. For an iV- 
dimensional open quantum system with Markovian dynamics, its state p(t) can be 
described by the following Markovian master equation (MME) (for details, see, e.g., 
[29], [92], [93]): 

N' 2 -l 

p(t) = -i[H(t),p(t)} a jk {[F jP (t),Fl] + [F v p{t)Fl\}. (13) 

j,k=0 

Here {Fj}jL^ 1 is a basis for the space of linear bounded operators on H with Fq = I, 
the coefficient matrix A = (ajk) is positive semidefinite and physically specifies the 
relevant relaxation rates. Markovian master equations have been widely used as models 
in Markovian quantum feedback (see Section 4.2). 
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2.3.3 Stochastic master equations 



In feedback control, we generally need to continuously monitor a quantum system to 
obtain feedback information. The evolution of a quantum system under continuous 
measurements of an observable X can be described by the following master equation 
[89]: 

dp = -i[H, p]dt - k[X, [X, p]]dt + V2k(X P + pX - 2(X)p)dW (14) 

where k is a parameter related to the measurement strength, (X) = tr(Xp), dW is a 
Wiener increment with zero mean and variance equal to dt and satisfies the following 
relationship to the measurement output y 

dW = dy- 2<JRtT(Xp)dt, (15) 

Equation (fT4"]) is usually called a stochastic master equation (SME). Such a stochastic 
master equation can be obtained as a filtering equation from quantum filtering theory 
(for details, see [16] . [62]). It is worth noting that the state p in the SME (|14H is a 
conditional state since it uses information from the continuous measurements. It should 
be pointed out that (|14h is only a typical form of SME and there exist many different 
types of SMEs which depend on different measurement processes [94J. 

Stochastic master equations have been derived for some quantum optical systems 
under continuous measurements. For example, we consider an atomic ensemble inter- 
acting with an electromagnetic field considered in [16]. Consider the atomic Hamilto- 
nian H(t) = AF z + u(t)F y , where A is the atomic detuning and u(t) is the strength of a 
magnetic field in the y-direction, and F z and F y are the collective dipole moments of the 
ensemble (for details, see [H]). ^ we neglect spontaneous emission, the corresponding 
SME is PS] 

dp = -i[u(t)F y + sF z ,p]dt - k[F z , [F z ,p]]dt + V2^(F z p + pF z - 2{F z )p)dW (16) 
where s is related to experimental parameters such as A, and dW satisfies 

dW = dy - 2^tr(F z p)dt. (17) 



2.3.4 Linear quantum stochastic differential equations 

In the BLM ©, MME ([13]) and SME ([11]), we use the Schrodinger picture of quan- 
tum mechanics where equations describing the time dependence of quantum states are 
given. In some cases, it is more convenient to adopt the Heisenberg picture where 
the time-dependent operators on T~L are used in describing the quantum dynamics. An 
interesting case is a class of noncommutative linear stochastic systems which includes 
many examples of interest in quantum technology, especially in linear quantum optics 
|57j . This class of systems can be described by the following linear quantum stochastic 
differential equation (LQSDE) [57] : 

dx{t) = Ax(t)dt + Bdw(t); x(0) = x hR) 
dy(t) = Cx{t)dt + Ddw(t) [ ' 
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where A, B, C and D are, respectively, R nxn , R nx?1 » ) M n f xn and M. n v xn ™ matrices 
(n,n w ,n y are positive integers), and x(t) = [x\(t) . . . x n (t)] T is a vector of self-adjoint 
possibly noncommutative system variables. 

The initial system variables x(0) = xq consist of operators (on an appropriate 
Hilbert space) satisfying the commutation relations 

[x j (0),x k (Q)]=2iQ jk ,j,k = l,...,n, (19) 

where Qjk are the components of a real antisymmetric matrix 0. For simplicity, we 
may take to have one of the following forms: (i) Canonical if = diag(J, . . . , J), 
or (ii) degenerate canonical if = diag(O n / xn /, J, . . . , J), where < n! < n, n' is the 
number of classical variables, and J = [i\ q]. The vector quantity w describes the 
input signals and is assumed to admit the decomposition 

dw(t) = p w (t)dt + dw(t) (20) 

where w(t) is the noise part of w(t) and /3 w (t) is a self-adjoint, adapted process (see 
[95], [96J). The noise w(t) is a vector of self-adjoint quantum noises with ltd table 

dw(t)dw T (t) = F^dt (21) 

where is a positive semidefinite Hermitian matrix (see [95], [96] for details). Equa- 
tion (|18p can describe quantum systems such as linear quantum optical systems. How- 
ever, it does not necessarily represent the dynamics of a meaningful physical system. 
We may need to add some additional constraints to ensure that a system described by 
equations of the form (fT8|) is physically realizable (for details, see Section [5] or [57]). 

3 Controllability and open-loop control of quantum sys- 
tems 

3.1 Controllability 

The controllability of quantum systems is a fundamental theoretical notion in quantum 
control as well as having practical importance because of its close connection with the 
universality of quantum computation [19] and the possibility of attaining atomic or 
molecular scale transformations [20] , [21] . Different notions of controllability for quan- 
tum systems have been proposed and some notions have been studied in depth [25]. In 
this section, we will briefly present some aspects of controllability for quantum systems. 
A common research focus is on BLM of quantum systems for which the controllability 
criteria may be expressed in terms of the structure and rank of the corresponding Lie 
groups and Lie algebras [25]. We denote the iV-dimensional complex unit sphere by 
and the Lie algebra generated by the operators {— iHo, —iH\, • • • , —iHk} as Cq. 
Also, we let U{N) (SU(N)) represent the iV-dimensional unitary group (special uni- 
tary group) and u(N) (su(N)) be the corresponding Lie algebra. Furthermore, we let 
lZ(\ip)) denote the reachable set of all states that are reachable from \ip). Now, we give 
several definitions of controllability and their corresponding testing criteria. 
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Definition 1 (Pure State Controllability) \2$ The quantum system |5]j is pure 
state controllable if for every pair of initial and final states, \ifjo) and \ipf) in S^~ l there 
exist control functions and a time t > such that the corresponding solution of 

at time t, with initial condition \ipo), is \ip(t)) = | ?/>/). 

Definition 2 (Operator Controllability) \2J$ The quantum system ^ is oper- 
ator controllable if there exist control functions {uk(t)} which drive the unitary operator 
U in from I to U f , for any U f G U{N) (or SU(N) ). 

Definition 3 (Eigenstate Controllability) J%3jj Suppose \<pi), ■ ■ ■ , \4>n) are the 
N eigenstates of the free Hamiltonian Hq. The quantum system (5$ is eigenstate con- 
trollable i/U=i^(l^)) = Sc' 1 - 

Theorem 4 [25] The quantum system ^ is pure state controllable if and only if 
the corresponding dynamical Lie algebra Co satisfies one of the following conditions: 
(1) Cq = su(N); (2) Cq is conjugate to sp{^), where sp{^-) is the ^- dimensional 
symplectic group; (3) Co = u(N); (4) Co = span{il]y x iy} ® C, where C is a Lie algebra 
conjugate to sp{^). 

Theorem 5 [241 The quantum system ([?[) is operator controllable if and only if 
C = u(N) (or C = su(N)). 

From the above definitions and theorems, we can see that the notion of opera- 
tor controllability is strongest of these quantum controllability notions and eigenstate 
controllability is weakest. If a quantum system is operator controllable, it is easy to 
show that it is also pure state controllable using ([6]) or by a comparison of Theorems 
H] and [5j If a quantum system is pure state controllable, it follows from the definitions 
that it must also be eigenstate controllable. Note that pure state controllability is also 
called wavefunction controllability in some references (e.g., [27], [28], [43]). Opera- 
tor controllability, in the unitary case, is also called complete controllability [22], [97] . 
Some algorithms have been developed for testing the controllability of specific quantum 
systems [20], [22], [25], [98]. 

The Lie algebra method allows for a straightforward mathematical treatment of 
closed quantum systems. However, the relevant criteria may be computationally dif- 
ficult when the dimension of the controlled system is large. Hence, another method 
based on graph theory has been developed for pure state controllability for which the 
controllability criterion becomes easy to verify. For simplicity, we consider the quantum 
system ([9]) with only a single control input u(t); i.e., 

iC(t) = AC(t) + u{t)BC(t) Co = (%)f=i (22) 

where the matrices A and B correspond to the free Hamiltonian and interaction Hamil- 
tonian, respectively. Now, we associate the system with a non-oriented connectivity 
graph G = (V, E), where the set of vertices V corresponds to the set of the eigenstates 
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\4>i) and the set of edges E corresponds to the set of all pairs of eigenstates directly 
coupled by the matrix B = {B. L j), 

G(V,E): F = {|0i),...,|0Ar)}, 

E = {m,\<P j ));i<j,B lJ ^0} . (23) 

Let Gk = (V( k \E^),k = 1,...,K be connected components of this graph. We 
denote by A« (i = 1, . . . ,N) the eigenvalues of the matrix A and let Vij = Aj — Xj 
= 1, . . . , N). The following theorem provides a sufficient condition for pure state 
controllability in terms of the connectivity graph |27j . [28] : 

Theorem 6 The system \22) is pure state controllable if the following conditions 
hold: 

(I) The graph G is connected; i.e. K = 1. 

(II) The graph G does not have "degenerate transitions". That is for all ^ (a,b), 
i j, a ^ b such that By ^ 0, B^ ^ 0, then ^ v^. 

(III) For each i,j,a,b = 1, . . . , N such that V{j ^ the number (fab/^ij) is rational. 

The proof of Theorem [6] can be found in |28j . The three conditions in Theorem [6] 
provide a sufficient but not a necessary condition for pure state controllability. In some 
circumstances, the assumptions (II) and (III) can be slightly relaxed |27| . Moreover, it 
is clear that if we add one more eigenstate into the set D, the pure state controllability 
criterion is easy to check for the resultant new system |27j . 

All of the above results consider finite dimensional quantum systems, which are a 
reasonable approximation to the quantum systems arising in many applications. Many 
practical quantum systems, especially those with continuous spectra, are essentially 
infinite dimensional; i.e., \ip(t)) in ([5]) is a unit vector in an infinite dimensional Hilbert 
space H. The controllability of such infinite dimensional quantum systems has been 
studied in [3]. For an infinite dimensional system ([5]), the existence of a dense analytic 
domain (in the sense of Nelson), together with some conditions on the corresponding 
Lie algebra, can guarantee its analytic controllability. The controllability of infinite 
dimensional quantum control systems has also been extensively studied in |21j . |99j . 

Another interesting focus is on the controllability of open quantum systems. It has 
been proven that a finite dimensional open quantum system with Markovian dynamics 
(i.e., MME (|13p ) is not controllable when using only coherent control [30]. However, 
finite dimensional open quantum systems with Kraus-map dynamics are complete kine- 
matic state controllable [26] and a specific Kraus map can be constructed for transfor- 
mation from an arbitrary initial state to a predefined target state if some incoherent 
resources are available as control tools [100] , jlOlj . A control approach involving gener- 
ating Kraus type dynamics can be potentially robust to variations of the initial system 
state [26]. 

3.2 Optimal control 

Most results on the controllability of quantum systems do not provide constructive 
methods to design a control law for driving a quantum system from an initial state to a 
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predetermined target state. Hence, it is desirable to develop useful methods to design 
such a control law. A straightforward strategy for constructing a suitable control law is 
based on a Lie group decomposition, where the desired system evolution operator Uf is 
decomposed as the product of basic unitary operators which are easy to generate using 
simple controls [25], |1U2| . [103J. This method is constructive and exact. However, 
it may be difficult to complete the decomposition for most practical systems. For 
many practical quantum control problems, optimal control theory is a powerful tool in 
achieving quantum control objectives [33], [104J. 

In the optimal control approach, the quantum control problem can be formulated 
as a problem of seeking a set of admissible controls satisfying the system dynamic 
equations and simultaneously minimizing a cost functional. The cost functional may 
be different according to the practical requirements of the quantum control problem, 
such as minimizing the control time [35], |105j . the control energy [91], |106j . the error 
between the final state and target state, or a combination of these requirements. Many 
useful tools in traditional optimal control, such as the variational method, the Pon- 
tryagin minimum principle and convergent iterative algorithms [107J, can be adapted 
to quantum systems and applied to search for optimal controls. Optimal control tech- 
niques have been widely applied to control quantum phenomena in physical chemistry 
(for details, see, e.g., [9J, [TT], [12], [108], pJl]) and NMR experiments [35]. [30]. [8T]. 

Here we present a simple example to demonstrate optimal quantum control design. 
We consider the model (jlip and assume u y (t) = 0. We can produce an x rotation of the 
spin by using radio-frequency (RF) pulses to control the system. The quantum control 
system becomes 

iU(t) = [I z + u x (t)I x ]U(t), U(0) = I (24) 

From Theorem [5j it is easy to check that the system (|24l) is operator controllable 
(completely controllable). It is possible to design a control law which is optimal in 
some sense to accomplish a specified quantum control task. In some applications, it is 
desirable to accomplish the control task as soon as possible in order to minimize the 
relaxation effects [35 j . For example, it is desirable to perform a quantum computation 
task with a minimum time using a collection of control resources [110J. Hence, the 
time-optimal control of quantum systems is an interesting practical problem [35], [105] . 
If the control is not bounded, we have the following theorem [35] . 

Theorem 7 Consider the model \2J$ . Given any Uf £ SU(2), there exists a unique 
j3 G [0, 2tt] such that Uf = exp(— ial x ) exp(—i/3I z ) exp(—i~fl x ), where a, 7 £ I, and 
the minimum time required in producing Uf is f3. 

If we ignore the global phase, we can denote the initial state \ipo) and the target 
state \ipf) as 

|^ >=cos^|0)+e^sin||l), (25) 

|^/) = cos^|0) + e^/sin-l|l) (26) 

where 6q, Of £ [0,7r], if 0, iff £ [0, 27r] and |V>/) = Uf\ipo). We can give an analytical 
expression for the minimal time required to accomplish this control task using geometric 
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manipulations on the Bloch sphere [52J. This minimum time f3 can be calculated 
according to the following equation: 



(3 = | arccos(sin#y cos ip j) 



arccos(sin 6*o cos v?o)| • 



(27) 




A formal proof of this result can be found in [53]. 



Under the assumption of bounded control (i.e., \u(t)\ < V G M + ), an interesting 
case is bang-bang control where the control u(t) switches between two values ±V. The 
solutions to many optimal problems take the form of bang-bang control |37j . The 
bang-bang control strategy has been used to suppress decoherence (the evolution 
of pure states to mixed states; e.g., see |86J) and to manipulate a class of coherent 
states |112| . To reduce the error introduced by the switches, the number of switches 
can be used as a performance index for optimal control design. Several algorithms 
have been developed to determine the minimum number of switches required. In one 
approach, the number of switches is determined by finding the minimum number of 
factors required in the factorization of Ut |113j . Another approach involves geometric 
analysis on the corresponding complex unit sphere (for details, see [53]). 

From the above example, we can see that, for the quantum system (|24j) . we may 
wish to optimize different cost functionals depending on the application. We may also 
use different methods to solve the same optimal quantum control problem. Optimal 
control is often combined with other strategies, such as closed-loop learning control 
and quantum feedback control, when manipulating quantum entanglement [69], identi- 
fying Hamiltonian parameters |76] , controlling chemical reactions [9] , |12j , and tracking 
quantum states [114] . 

3.3 Lyapunov-based control design 

Lyapunov-based control methods are powerful tools for feedback controller design in 
classical control theory. In quantum control, the acquisition of feedback information 
through measurements usually destroys the state being measured, which makes it dif- 
ficult to directly apply Lyapunov approaches to quantum feedback controller design. 
However, we may first complete the feedback control design by simulation on a com- 
puter, which will give a sequence of controls. Then we can apply the control sequence 
to the quantum system to be controlled in an open-loop form |41] , |42] . |115j - [l"2~l"] . 
This is a "feedback design and open-loop control" strategy. This strategy is especially 
useful for some difficult quantum control tasks |120] , The most important aspects in 
Lyapunov-based control design include the construction of the Lyapunov function, the 
determination of the control law and the analysis of asymptotic convergence. 

To design an open-loop control law for quantum systems, several types of Lyapunov 
functions have been considered. For example, if the target state is \ipf), we may select 
one of the following Lyapunov functions: V\(t) = |(1 — \(ipf\ip(t))\ 2 ) [116] . V^i) = 
(ip(t) — ipf\tp(t) — tpf) [41] . or V-j(t) = (ip(t)\P\ip(t)), where P is a positive semidefinite 
Hermitian operator [117J. It is clear that Vj(t) > (j = 1,2,3). We can now select 
the control function to guarantee that the first-order time derivative of the Lyapunov 
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function is negative semidefinite. That is, we may determine the control law using the 
condition V{t) < on the Lyapunov function V(t). 

For the case that the target state is an eigenstate of the free Hamiltonian Hq, 
several algorithms have been developed to find corresponding control laws and their 
convergence has been analyzed [32], [1 16] . |117j . For the case that target states are not 
eigenstates of Hq, the control problem can be formulated in terms of reference trajectory 
tracking [41] , [118] , [122] . Lyapunov-based techniques have also been formulated using 
density operators for the control of a spin ensemble [120], [121] . LaSalle's invariance 
principle is also useful to characterize the asymptotic behavior of the system dynamics 



3.4 Variable structure control 



For some quantum systems which are not controllable, we can introduce additional 
resources or special strategies to change the controllability of the quantum system 
or enhance our capability of controlling the quantum system. In this subsection, we 
introduce a variable structure control strategy to enhance our capability of controlling 
a class of quantum systems. In variable structure control, one can change the controller 
structure according to specified switching logic in order to obtain improved properties 



(28) 
(29) 



Consider an example corresponding to two special cases of ([9]): 

iC(t) = AC(t) + ui(t)B x C(t) = (A + B%)C(t); 

iC{t) = AC(t) + u 2 (t)B 2 C(t) = {A + B%)C(t) 
where A = diag{1.0, 1.2, 1.3, 2.0, 2.15}, and 



B^ 



( ui(t) ui(t)\ 





«i(t) ut(t) 

\ui(t) ui(t) / 



B u 2 



( 




V o 







u 2 (t) 
u 2 (t) 



u 2 (t) 







\ 

u 2 (t) u 2 (t) 



u 2 (t) 

u 2 (t) / 



In [43] . it has been shown that the two models (|28j) and (|29p are not individually 
pure state controllable but are controllable under a variable structure control strategy. 
Furthermore, consider a system (S m ): 



iC(t) = (A + B£)C(t) (m = l,...,M) 



(30) 



The corresponding connectivity graph of B^ is denoted as G m = (V m ,E m ). It is clear 
that for arbitrary m, V m = V = {\4>i), . . . , \4>n)}- Hence, we can write G m = (V,E m ) 
and define G = (V, E) as the combined graph of G m = (V, E m ) (m = 1, . . . , M) where 
E = E\ U E 2 U • ■ • U Em- We then give the following theorem [44] . 



Theorem 8 The system 

iC(t) = (A + B u )C(t) 



C(0) = C B u e{Bl...,B M } 



(31) 
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is pure state controllable if the controller B u can be arbitrarily switched between con- 
trollers B^ and (m 7^ n, 1 < m,n < M), and the following assumptions hold: 

(I) The combined graph G for the system \'J1\) is connected. 

(II) The combined graph G remains connected after elimination of edge pairs 
|0z})? (|0a)>|0&)) such that Vji = v a ^ (degenerate transitions). 

The proof of this theorem can be found in [44]. The variable structure control 
strategy provides a useful method for open-loop control design for a class of quantum 
systems and is also applicable to qubit preparation for quantum information processing 
(for details, see [43], [44]). Here, for open- loop control of quantum systems, we only 
use the concept of variable structure control and consider control inputs which are 
allowed to switch between a number of different control structures. Moreover, note 
that sliding mode control is an important aspect in variable structure control of classical 
systems. Also, the sliding mode method can be used to deal with uncertainties in the 
feedback control of quantum systems and has potential applications to quantum state 
preparation and quantum error correction |123j . 

3.5 Incoherent control 

The above discussions on open-loop quantum control focus on coherent control where 
we can manipulate the state of a quantum system by applying semiclassical potentials 
in a fashion that preserves quantum coherence [17] . The control inputs commonly oc- 
cur as tunable parameters in the Hamiltonian of the system and can directly affect 
the coherent part of the dynamics. There exist some physical situations where it is 
not possible or very difficult to control the state of a quantum system directly with 
coherent resources (unitary transformations) [49]. For example, it has been proven 
that a finite dimensional open quantum system with Markovian dynamics is not con- 
trollable using only coherent control [30J, |124j . A natural extension of these quantum 
control methods is to introduce incoherent resources (called "incoherent control") to 
enhance our capability of controlling quantum systems or to help in control design in 
order to accomplish specified tasks. The main paradigms for introducing incoherent 
resources into open- loop quantum control include incoherent control fields [12] , the use 
of auxiliary systems (environments) and quantum measurements [45]-|55|. [125) - [127] . 

Quantum measurements are regarded as deleterious in accomplishing coherent con- 
trol tasks since they usually destroy the coherent characteristics of the quantum system. 
However, recent results show that quantum measurements can improve the controlla- 
bility of quantum systems in some situations. Indeed, sometimes a quantum system 
which is not unitarily controllable can be controlled by the joint action of projective 
measurement and unitary evolution [45] . |48| . Let us consider the model ([5]), and let 
G(A) denote the Lie group generated by the operators {—iHo, —iH±, . . . , —iHx}- Also, 
let O(N) be the A^-dimensional orthogonal group. We then have the following theorem 

Theorem 9 Given any goal state \ipf), there is a family of observables M(\ipf)) 
such that measurement of one of these observables on any \i[>q) plus unitary evolution 
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leads to \ipf) if G{A) is equal to either 0(N) or sp{-^). 

The proof of this theorem can be found in |45j . If G{A) is equal to either U(N) or 
sp(y), the corresponding system is pure state controllable and it might still be more 
efficient to use the measurement plus evolution strategy [35] . Several incoherent control 
schemes based on quantum measurements have been proposed. For example, a control 
scheme for mapping an unknown mixed quantum state onto a known pure state has been 
proposed with the help of sequential measurements of two noncommutative observables 
and without the use of unitary transformations |125j . A probabilistic quantum control 
strategy using indirect measurement is presented for the remote control of quantum 
systems |48j . Projective measurements on several identical initial states are used to help 
complete the control design of quantum systems with pure state controllable subspaces 
|51j . Projective measurements are also combined with amplitude amplification for the 
state control of locally controllable quantum systems [55] . In these incoherent control 
schemes, we emphasize the role of measurement as a control tool. Although we may 
use the measurement result, we present these methods as open-loop control strategies 
since no real closed-loop is constructed in the control process. 

Quantum measurements can be used as an effective control tool in quantum control. 
In practical applications, the realization of a quantum measurement on a quantum 
system is usually accomplished by entangling the quantum system with an auxiliary 
system (a probe). Hence, one can also control a quantum system by controlling an 
auxiliary system (e.g., a probe) entangled with the quantum system. Under suitable 
conditions on the interaction of the system to be controlled, the auxiliary system, 
and the environment, the system dynamics is completely controllable by varying the 
initial state of the auxiliary system |49j . |50| or manipulating the local Hamiltonian 
of the auxiliary system [128J, which has potential applications to quantum networks 
[129J. Furthermore, if all kinds of coherent and incoherent resources are available, in 
principle, we can control a (closed or open) quantum system from an arbitrary initial 
state to a predefined target state |100| . [101J. 

4 Some results on closed-loop design methods 

As presented in Section [3j open-loop control has achieved many successes in the control 
of some simple quantum systems. However, it suffers some difficulties for more complex 
quantum control tasks such as suppressing decoherence and dealing with disturbances 
in quantum systems. A natural solution to this problem is to explore closed- loop 
control strategies. Two forms for closed-loop control have been proposed for quantum 
systems: closed-loop learning control and quantum feedback control. In closed-loop 
learning control, each cycle of the closed-loop is executed on a new sample. However, 
in quantum feedback control, the same sample is involved during the whole process of 
control [9]. In this section, we will present some aspects of quantum feedback control 
after a brief introduction to closed-loop learning control. 
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4.1 Closed-loop learning control 

Closed-loop learning control has achieved great successes in the control of laboratory 
chemical reactions [9], [58] . The closed- loop learning control procedure generally in- 
volves three elements [9j: (i) a trial laser control input design, (ii) the laboratory gen- 
eration of the control that is applied to the sample and subsequently observed for its 
impact, and (hi) a learning algorithm that considers the prior experiments and suggests 
the form of the next control input. The initial trial control input may be a well-designed 
laser pulse or a random control input. A feature of a good closed-loop learning control 
strategy is its insensitivity to the initial trials. An important task is to establish a 
good learning algorithm for ensuring that the closed-loop learning process converges 
to achieve a given control objective. Genetic algorithms and several rapid convergence 
algorithms have been employed for this task [58], |107| . The control objective is usually 
formulated as an optimal control problem by converting the problem into a problem of 
optimizing a functional of the quantum states, control inputs, control time, etc. In the 
learning process, an optimal control problem is solved iteratively. First, one applies 
a trial input to a sample to be controlled and observes the result. Second, a learning 
algorithm suggests a better control input based on the prior experiments. Third, one 
applies a "better" control input to a new sample. This process continues in order to 
achieve the control objective. It is often easy to produce many identical-state samples 
in laboratory chemical reactions. If the control objective is well defined, there is a capa- 
bility to apply specified control inputs to the samples. Then, if a sufficiently intelligent 
learning algorithm is applied to adjust the control inputs, this process will converge to 
optimize the required objective and an optimal control will be found [9]. 

4.2 Quantum feedback control 

As we know, feedback is an effective strategy in classical control theory and the aim 
of feedback is to compensate for the effects of unpredictable disturbances on a system 
under control, or to make automatic control possible when the initial state of the sys- 
tem is unknown. In classical control, many results have shown that feedback control 
is superior to open-loop control. In feedback control, it is usually necessary to obtain 
the information about the state of system through measurement. However, measure- 
ments of a quantum system will unavoidably disturb the state of measured quantum 
system, which makes the situation more complex when applying feedback to quantum 
systems. In spite of this difficulty, important progress has been made and feedback has 
been used to improve the control performance for squeezed states [60], [130] . quantum 
entanglement |131| . [132] . |133j . and quantum state reduction [62]- [65], |134| - [T38] in 
many areas such as quantum optics [15] , [82] , superconducting quantum systems |138] , 
Bose-Einstein condensate [139] and nanomechanical systems [140] . Quantum feedback 
control has also been compared with open-loop control (e.g., see [141] ). It has been 
proven for a specific quantum system that quantum feedback is superior to open-loop 
control in dealing with uncertainties in initial states and it has also been demonstrated 
via simulation that feedback control is still better than open-loop control for dealing 
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with decoherence [141] . 

In quantum feedback control, the two main approaches to information acquisition 
are projective measurement and continuous weak measurement. The system to be 
controlled is a quantum system, however, the controller may be quantum, classical or 
a quantum/classical hybrid. Several paradigms of quantum feedback have been pro- 
posed, such as Markovian quantum feedback [15], [142] . Bayesian quantum feedback 
[73] . [143] . |144j . and coherent quantum feedback [17], [57]. In Markovian quantum 
feedback, any time delay is ignored and a memoryless controller is assumed. That is, 
the measurement record is immediately fed back onto the system to alter the system 
dynamics and may then be forgotten [145] . Hence, the equation describing the resulting 
evolution is a Markovian master equation. In Bayesian quantum feedback, the process 
is divided into two steps involving state estimation and feedback control. The best 
estimates of the dynamical variables are obtained continuously from the measurement 
record, and fed back to control the system dynamics [73] . The dynamical equation 
describing the resulting evolution is non-Markovian. In coherent quantum feedback, 
the feedback controller itself is a quantum system, and it processes quantum informa- 
tion. This is greatly different from Markovian and Bayesian quantum feedback where 
the feedback information from measurement results is classical information and the 
feedback controller is a classical controller. In the following, we will present several 
important aspects of quantum feedback control including quantum filtering, feedback 
stabilization, optimal feedback control and robust control. 

4.2.1 Identification and filtering/estimation 

To design an effective quantum feedback control system, it is necessary to obtain knowl- 
edge of a system model and system states. This can be regarded as a quantum system 
identification or state estimation problem. The simplest example is to estimate the sys- 
tem state for feedback through projective measurements on a quantum ensemble. This 
is a simple problem in classical control which can usually be accomplished through 
direct measurements. However it becomes much more complex due to the quantum 
collapse postulate of measurement in quantum control. This problem of identifying 
quantum states is also called quantum state tomography in quantum information and 
some procedures have been developed to experimentally determine an unknown quan- 
tum state [80]. Some of these procedures can be used in quantum feedback control. 
Another example is the identification of parameters for a quantum operation (e.g., a 
quantum gate or the system Hamiltonian) . This procedure is called as quantum pro- 
cess tomography and some techniques have been developed (e.g., see [76] . [80]). To 
acquire information about a quantum operation, an attractive approach is quantum 
nondemolition measurements which do not disturb the value to be measured. However, 
it is not practical to design quantum nondemolition measurements for most problems 
(see [146 J for details). 

Furthermore, it is often useful to estimate an unknown dynamical parameter through 
continuously monitoring an open quantum system [147] . [148] . Since continuous ob- 
servations of open quantum systems are inherently noisy, quantum filtering theory is 
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required for extracting information from a noisy signal [71]. Quantum filtering theory 
has been developed for quantum optical systems and is used as an essential component 
in some quantum feedback control strategies |7U| . |72j . [96] . |149j . In the framework of 
noncommutative (or quantum) probability theory, a broad class of quantum stochastic 
differential equations can be obtained (for details, see, e.g., [71]). In fact, the SME 
model (|14p is a quantum filtering equation which describes the evolution of a condi- 
tional state. Recently, several robustness properties of quantum filtering and estimation 
have also been investigated for linear and nonlinear quantum systems |75j , |150j , |151j . 

4.2.2 Feedback stabilization/control 

Based on the use of feedback information from measurements or estimation, one can 
design a feedback controller to control or stabilize a quantum system. In Markovian 
quantum feedback, the feedback Hamiltonian is commonly selected as a linear function 
of the feedback signal. For example, the feedback Hamiltonian in Markovian feed- 
back control via homodyne detection may be selected as Hfb(t) = F(t)I(t), where 
F(t) is a Hermitian operator and I(t) is a current from the measurement |15| . |145| . 
[152J. Then the feedback Hamiltonian will enter the system Hamiltonian to alter the 
system evolution. Markovian quantum feedback has been widely applied in the stabi- 
lization of arbitrary pure states of two-level systems |152| . noiseless subspace generation 
[153J, continuous quantum error correction |154j . etc. In Bayesian quantum feedback, 
the feedback Hamiltonian is a general function of the measurement record [73] . |155| . 
which is used to control the system dynamics. Bayesian feedback is usually superior 
to Markovian feedback since it uses more information. However, it is more difficult 
to implement Bayesian feedback than Markovian feedback due to the existence of the 
estimation step [145J. Bayesian feedback has also been applied in the preparation of 
quantum states [155] and quantum error correction [66] , [67] . If the feedback delay can- 
not be ignored, the feedback Hamiltonian must include a delay parameter [156] which 
in some cases has a qualitatively similar effect to that of unprecise measurement |157] . 
Both Markovian feedback and Bayesian feedback use information from measurement 
(or estimation) and the feedback controller is usually a classical controller. Another 
different feedback paradigm is coherent quantum feedback, where a quantum controller 
(i.e., the controller is another quantum system) directly affects the system dynamics to 
be controlled [TTJ, [158], [T59] , 

In quantum feedback control, the filtering SME is an important dynamical equation 
for the design of the feedback control system. For example, for a quantum system 
described by an SME, one may use stochastic Lyapunov techniques to design a feedback 
control law for asymptotically stabilizing the quantum system to an objective state. For 
the model (fT6|) . if S = {p € C NxN : p = /c',trp = l,p > 0}, we have the following 
result [63]: 

Theorem 10 Consider the system M6\) evolving in the set S. Let the final state 
Pf = Vfv\, where Vf is an eigenstate \<f> m ) (1 < m < N ), and let 7 > 0. Consider the 
following control law: 
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1. Ut = -tr(i[Fy,p t ]pf) iftr(p t pf) > 7. 

2. ut = l iftr(p tP f)<^/2. 

3. If pt G B = {p : 7/2 < tr(ppf) < 7}, then u t = — tr(i[F y ,p t ]pf) if pt last entered 
B through the boundary tr(ppj) = 7, and ut = 1 otherwise. 

Then there exists a 7 > such that ut globally stabilizes \16\) around pf and Epi — > pj 
as t — > 00 . 



4.2.3 LQG control 

Under appropriate assumptions, some quantum optical systems can be approximately 
modeled by LQSDEs driven by quantum Wiener processes [56], |160| . This simplifi- 
cation provides an opportunity to develop quantum linear-quadratic-Gaussian (LQG) 
control to obtain an optimal feedback strategy [4], [69], [70], [73], |143j . [160] . |161j . 
[162J. In LQG control, the goal is to find an optimal feedback control law for a stochas- 
tic linear system by optimizing a quadratic cost functional. In some cases, results from 
classical LQG control can be applied to quantum systems |163| . An important result 
is the separation theorem which applies when the system is linear, the cost functional 
is quadratic in the system variables and the noises are Gaussian. In this situation, the 
values of optimal estimates are fed back. Then, when calculating the feedback required 
for the optimal control, we may assume that the dynamical variables are known exactly 

In the quantum LQG control problem, the optimal control is also a linear feedback 
control law. The controller may be a classical controller [162J or a quantum controller 
[158] . |159j . For classical controllers, it is straightforward to apply results in classical 
LQG control to quantum LQG problems. In fact, some results on quantum LQG 
control with classical controllers have been developed in [69 , [73], |143j . |160| . |162j . 
For controllers which are themselves quantum systems, we must add some additional 
constraints on coefficient matrices to ensure that the controller is physically realizable. 
For example, [57] has developed a notion of physical realizability based on the concept of 
an open quantum harmonic oscillator as the basic components of a physically realizable 
quantum system. Under several reasonable assumptions on a system of the form (|18p 
(e.g., n y is even, n w > n y , F w = I + idiag(J, . . . , J), etc.; see [57] for details), we have 
the following results on physical realizability [57J: 



Theorem 11 The system U8\) is physically realizable if and only if: 

iAG + i®A T + BT W B T = 0, (32) 



B 



n v xn 





QC T diag Nv (J) (33) 

(n^j —n y )xn y _ 

D= [iriyXny Qn y x(nu~n y )\ (34) 



where N y = ^ and T u = ^(F^ — F^). 
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Hence, the problem of quantum LQG control with a quantum controller is con- 
verted into the following problem: Given a canonical commutation relation, find a 
feedback controller, whose coefficient matrices satisfy the conditions of physical realiz- 
ability in Theorem II 1\ that minimizes a quadratic performance index. The additional 
constraints on the coefficients for controllers make the problem more complex. Indeed, 
new algorithms are required to be developed in order to solve this problem. In |159j . a 
numerical procedure based on an alternating projection algorithm has been developed 
to solve this control problem. Furthermore, several results on synthesizing coherent 
quantum controllers have also been presented (e.g., see [164J). 

4.2.4 Robust control 

In practical applications, it is unavoidable that quantum systems are subject to all 
kinds of disturbances and uncertainties [165] . Many instances of incomplete knowledge 
and unknown errors can also be treated as uncertainties. Hence, robustness has been 
identified as an important aspect for the practical application of quantum technology 
|79j . |166j . [167] . Recently, several robust control methods in classical control theory 
have been extended into quantum domain. For example, the small gain theorem has 
been applied to the stability analysis of quantum feedback networks |79j. A transfer 
function approach has been applied to the feedback and robust control for single input 
single output quantum systems [168J, |169j . An H°° controller synthesis problem has 
been formulated for a class of linear quantum stochastic systems [57J. A sliding mode 
control approach has been applied to robust control design for quantum systems where 
bounded uncertainties exist in the system Hamiltonian [123] . Some open-loop and 
feedback approaches to quantum control can lead to a certain degree of robustness. 
Since feedback plays a key role in robust control, in this survey we present robust 
control within the framework of quantum feedback control. In the following, we will 
only present several specific results on H°° control for quantum systems, which is based 
on the reference |57| . 

Consider the quantum system to be controlled to be described by the following 
LQSDE defined in an analogous way to (|18jk 



where the input w(t) represents a disturbance signal of the form (|20p . Also, dv(t) 
represents any additional quantum noise in the system. The control input u(t) can be 
written as 



where j3 u {t) is the adapted, self-adjoint part of u(t) and u(t) is the noise part of u(t). 
The vectors v(t), w(t), and u(t) are quantum noises with positive semidefinite Hermitian 
ltd matrices F v , F^, and F^. 



dx{t) = Ax(t)dt + [B Bi B 2 ] x [dv(t) T dw(t) T du(t) T ] T ; x(0) = 
dz(t) = Cxx(t)dt + D l2 du(t) 

dy(t) = C 2 x(t)dt + [D 20 D 21 %xn J x [dv{t) T dw{t) T du(t) T ] T . 



(35) 



du(t) = f3 u (t)dt + du(t) 



(36) 
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The controller is assumed to be of the following form 

dx(t) = A K £(t)dt + [B K1 B K \ x [dv K (t) T dy(t) T ] T ; £(0) = £o 



du(t) = C K i{t)dt + [B K0 nuXny ] x [dv K (t) T dy{t) T ] T (37) 

where £(t) = [£i(i) ■ ■ ■ Cn{t)] T is a vector of self-adjoint controller variables. The noise 
VK(t) = \vK\{t) ■ ■ - VKK v (t)] T is a vector of noncommutative Wiener processes with 
canonical Hermitian Ito matrix F VK . 

By identifying f3 u = CxS,{t) and interconnecting ([35]) and ([37]) . we can obtain the 
resulting closed-loop system (see [57] ) . The goal of the H°° controller synthesis problem 
is to find a controller (|3T[) for a given disturbance attenuation parameter g > such 
that the resulting closed- loop system satisfies (for details, see [57] ) 

t ft 

{^(sf^(s) + ei 1 (s) T r } (s))ds<(g 2 -e) / (p u {8? p u {s))da + m + » 2 t, V* > (38) 

J 

for some real constants e, /ii, fi 2 > 0, where /3 2 (i) = [Ci D^Ck] [x{t) T £,(t) T ] T . 

Furthermore, we suppose that the system ([35]) satisfies the following assumption 
(Assumption A): 1) Df 2 D 12 = E x > 0; 2) D21-D21 = ^2 > 0; 3) The matrix [ A "^ 7 ^ ] 
is full rank for all w > 0; 4) The matrix [ A ~^ 1 ^ 1 is ful1 rank for all w > 0. 

The results on quantum H°° control will be stated in terms of the following pair of 
algebraic Riccati equations: 

(A - B 2 E^ l Dj 2 C 1 ) T X + X(A - B 2 E^ 1 Df 2 C 1 ) + X^Bf - g 2 B 2 E^ l B 2 T )X 
+g- 2 CT(I-D 12 E^ l Dj; 2 )C 1 =0 

(39) 

(A - B x Dl x E 2 x C 2 )Y + Y(A - B 1 D^ 1 E 2 1 C 2 ) T + Y(g~ 2 Cf C x - C?E 2 l C 2 )Y 
+B\(I — D 2l E 2 1 D 2 i)BT = 1 ' 

where X and Y are positive definite symmetric matrices. The solutions to these Riccati 
equations will be required to satisfy the following assumption (Assumption B): 1) A — 
B 2 E^D\ 2 C X + (B 1 Bf - g 2 B 2 E^ 1 B 2 r )X is a stability matrix; 2) A - B x Dl x E 2 x C 2 + 
Y(g~ 2 C^C\ — C 2 E 2 ^C 2 ) is a stability matrix; 3) The matrix XY has a spectral radius 
strictly less than one. 

If the Riccati equations (|39p and (|40p have solutions satisfying Assumption B, a 
controller of the form (j37H will solve the H°° control problem under consideration and 
the system matrices of the controller can be constructed from the Riccati solutions as 
follows: 

A K = A + B 2 C K - B K C 2 + {B x - B K D 21 )BfX 

B K = {I- YXy^YCj + BtD^E^ 1 (41) 

C K = -E^ 1 (g 2 B 2 T X + Dl 2 C 1 ). 

The necessary and sufficient conditions on H°° controller synthesis can be described 
as follows: 



Theorem 12 Necessity. Consider the system iSdu and suppose that Assumption A 



is satisfied. If there exists a controller of the form (31) such that the resulting closed- 



loop system is strictly bounded real with disturbance attenuation g, then the Riccati 
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equations t39\) and f^0| ) will have stabilizing solutions X > and Y > satisfying 
Assumption B. 

Sufficiency. Suppose the Riccati equations k°3y\) and J^^| ) have stabilizing solutions 
X > and Y > satisfying Assumption B. If the controller flgTj ) is smc/i £/ia£ £/ie 
matrices Ax, Bx, Cx ar ^ a $ defined in J^i| j ; i/ien £/ie resulting closed-loop system will 
be strictly bounded real with disturbance attenuation g. 

It is worth noting that when the controller which is constructed via this approach is 
a quantum controller, we need to take into account the physical realizability conditions 
using Theorem II li 

5 Conclusions and perspectives 

In this paper, we have surveyed developments in quantum control theory and its appli- 
cations from a control systems perspective. Some results on controllability of quantum 
systems, open-loop control strategies and closed-loop design methods have been pre- 
sented. Also, some applications of quantum control theory are briefly mentioned in 
this survey. Although great progress has been made in this area, quantum control is 
still in its infancy. Moreover, there exist several essential differences between quan- 
tum control theory and classical control theory. For example, controlling quantum 
entanglement and protecting quantum coherence are important two classes of quantum 
control tasks. However, no corresponding tasks exist in classical control theory. In 
classical feedback control, measurement is taken as the main tool of acquiring feed- 
back information to deal with uncertainties and it is assumed that measurement does 
not affect the measured system. However, measurement in quantum feedback control 
unavoidably introduces essential uncertainties when we acquire feedback information 
through measurement to deal with uncertainties of quantum control systems. Hence, it 
is necessary to develop more new theory and approaches to control quantum phenom- 
ena. We now outline several important topics that are worth exploring, emphasizing 
different aspects of quantum control (a more detailed discussion on mathematical and 
algorithmic challenges in quantum control can be found in |170| ). 

(1) Quantum incoherent control. Quantum coherent control is a powerful con- 
trol paradigm in open-loop quantum control and many important results have been 
achieved. However, it may not be practical to accomplish some quantum control 
tasks using only coherent control approaches. Recently, incoherent resources have been 
proven useful for accomplishing some quantum control tasks. An example of this is 
the fact that quantum measurement can serve as a useful control tool. However, there 
are only few results on the use of quantum incoherent control. Hence, it is desirable 
to develop systematic and new approaches to construct quantum incoherent (or coher- 
ent/incoherent hybrid) controllers which are easily physically realized |54j . 

(2) Quantum feedback control. Feedback plays a key role in classical control theory. 
It is desirable to develop systematic feedback control methods for emerging quantum 
engineering applications. Although many results on quantum feedback control have 
been presented, they are usually constrained to some special cases (e.g., linear feedback, 
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Markovian approximation, simple quantum systems). Many fundamental problems still 
need to be considered: How does the weak measurement |171] affect quantum systems 
in quantum feedback control? How does one design feedback controllers for nonlinear 
quantum systems [172] and is it possible to control nonlinear dynamics of quantum 
systems using linear controllers? What approaches are effective for control of quantum 
systems with non-Markovian dynamics [156], |157j . [173] ? What is the capability of 
feedback to deal with uncertainties in quantum systems? How do we synthesize complex 
quantum feedback network systems [174] ? 

(3) Robust control of quantum systems. It is inevitable that quantum systems are 
subject to many kinds of uncertainties (including disturbances and noises). Hence, 
the requirement of robustness in the presence of uncertainties has been recognized as 
one of the key tasks for developing practical quantum technologies. Existing results 
in this area focus mainly on quantum systems whose dynamics can be described by 
linear equations in the Heisenberg picture [57], [175] or whose uncertainties can be 
approximately described as a perturbation in the system Hamiltonian. It is desirable 
to develop systematic robust control approaches to deal with more general kinds of 
uncertainties existing in practical quantum systems. 

(4) Decoherence control. Decoherence is the main obstacle to the application of 
quantum information technology. Many quantum control systems are essentially open 
quantum systems |29j . |176] and interaction with external environments (including 
external controls and the measurement apparatus) unavoidably introduces decoher- 
ence |177j . A typical example of decoherence control is quantum error correction [66 1, 
[67] , [154] . Several decoherence control approaches have been proposed. For exam- 
ple, "bang-bang" control has been proposed for dynamic decoherence suppression in 
two-state quantum systems [111] . A classical feedback strategy has been proposed to 
eliminate decoherence in open quantum systems [178] . Optimal control techniques have 
been applied to decoherence control of Markovian and non-Markovian open quantum 
systems [173J, [179]. [180] . In spite of these efforts, there are still many challenges 
for decoherence control and the development of systematic and practical decoherence 
control methods is still an important problem. 

(5) Entanglement control. Quantum entanglement is the most important resource 
in quantum information technology. Several optimal control and feedback control ap- 
proaches have been proposed to control quantum entanglement [61], [69], [131] . [132] . 
[133J, (181 j . [182] , However, existing results are only a first step in entanglement con- 
trol. Quantum entanglement has many unique characteristics which have no classical 
counterparts. Hence, it is desirable to develop completely new methods to control 
quantum entanglement. Moreover, we still lack a suitable theory that can effectively 
characterize quantum entanglement. This makes the development of a control theory 
for quantum entanglement more challenging. 
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